Pavlovian-instrumental Transfer Research Articles

Effects of sleep deprivation on food-related Pavlovian-instrumental transfer: a randomized crossover experiment.

Recent research suggests that insufficient sleep elevates the risk of obesity. Although the mechanisms underlying the relationship between insufficient sleep and obesity are not fully understood, preliminary evidence suggests that insufficient sleep may intensify habitual control of behavior, leading to greater cue-elicited food-seeking behavior that is insensitive to satiation. The present study tested this hypothesis using a within-individual, randomized, crossover experiment. Ninety-six adults underwent a one-night normal sleep duration (NSD) condition and a one-night total sleep deprivation (TSD) condition. They also completed the Pavlovian-instrumental transfer paradigm in which their instrumental responses for food in the presence and absence of conditioned cues were recorded. The sleep × cue × satiation interaction was significant, indicating that the enhancing effect of conditioned cues on food-seeking responses significantly differed across sleep × satiation conditions. However, this effect was observed in NSD but not TSD, and it disappeared after satiation. This finding contradicted the hypothesis but aligned with previous literature on the effect of sleep disruption on appetitive conditioning in animals-sleep disruption following learning impaired the expression of appetitive behavior. The present finding is the first evidence for the role of sleep in Pavlovian-instrumental transfer effects. Future research is needed to further disentangle how sleep influences motivational mechanisms underlying eating.

Stimulus-outcome associations are required for the expression of specific Pavlovian-instrumental transfer.

A series of experiments employed a specific Pavlovian-instrumental transfer (PIT) task in rats to determine the capacity of various treatments to undermine two outcome-specific stimulus-outcome (S-O) associations. Experiment 1 tested a random treatment, which involved uncorrelated presentations of the two stimuli and their predicted outcomes. This treatment disrupted the capacity of the outcome-specific S-O associations to drive specific PIT. Experiment 2 used a negative-contingency treatment during which the predicted outcomes were exclusively delivered in the absence of their associated stimulus. This treatment spared specific PIT, suggesting that it left the outcome-specific S-O associations relatively intact. The same outcome was obtained in Experiment 3, which implemented a zero-contingency treatment consisting of delivering the predicted outcomes in the presence and absence of their associated stimulus. Experiment 4 tested a mixed treatment, which distributed the predicted outcomes at an equal rate during each stimulus. This treatment disrupted the capacity of the outcome-specific S-O associations to drive specific PIT. We suggest that the mixed treatment disrupted specific PIT by generating new and competing outcome-specific S-O associations. By contrast, we propose that the random treatment disrupted specific PIT by undermining the original outcome-specific S-O associations, indicating that these associations must be retrieved to express specific PIT. We discuss how these findings inform our theoretical understanding of the mechanisms underlying this phenomenon. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Supplemental Material for Stimulus–Outcome Associations Are Required for the Expression of Specific Pavlovian-Instrumental Transfer

Supplemental Material for Stimulus–Outcome Associations Are Required for the Expression of Specific Pavlovian-Instrumental Transfer

Technology of the photobiostimulation of the brain's drainage system during sleep for improvement of learning and memory in male mice.

In this study on healthy male mice using confocal imaging of dye spreading in the brain and its further accumulation in the peripheral lymphatics, we demonstrate stronger effects of photobiomodulation (PBM) on the brain's drainage system in sleeping vs. awake animals. Using the Pavlovian instrumental transfer probe and the 2-objects-location test, we found that the 10-day course of PBM during sleep vs. wakefulness promotes improved learning and spatial memory in mice. For the first time, we present the technology for PBM under electroencephalographic (EEG) control that incorporates modern state of the art facilities of optoelectronics and biopotential detection and that can be built of relatively cheap and commercially available components. These findings open a new niche in the development of smart technologies for phototherapy of brain diseases during sleep.

Ghrelin receptor antagonism and satiety attenuate Pavlovian-instrumental transfer

Animals rely on learned cues to guide their behaviour for rewards such as food. The Pavlovian-instrumental transfer (PIT) task can be used to investigate the influence of Pavlovian stimuli on instrumental responding. Ghrelin, an orexigenic peptide, and its receptor, growth hormone secretagogue receptor 1A (GHS-R1A), has received growing interest for its role in reward-motivated learning and behaviours. A significant population of GHS-R1A have been identified within the ventral tegmental area (VTA), a critical node in the mesolimbic reward circuit that is necessary for the expression of PIT. As ghrelin has been found to increase dopaminergic activity in the VTA, we predicted that GHS-R1A antagonism with JMV-2959 would attenuate PIT. Further, given the relationship between hunger levels and changes in ghrelin signalling, we sought to compare the effects GHS-R1A antagonism with those of satiety, hypothesizing parallel effects, with each attenuating PIT. Rats received daily sessions of Pavlovian and then instrumental training over 3 weeks. Across three experiments, we examined the effects of a shift to satiety, or treatment with the GHS-R1A antagonist JMV-2959, either peripherally or directly into the VTA. We found that presentations of a stimulus paired with food reward enhanced responding for food across all conditions, thus demonstrating the expected PIT effect. Further, GHS-R1A antagonism, both peripherally and within the VTA, as well as satiety significantly reduced the magnitude of the PIT effect compared to control conditions. These results clarify our understanding of ghrelin signalling in PIT and begin to elucidate the role of feeding-related peptides in the modulation of reward-related responding.

Diet and obesity effects on cue-driven food-seeking: insights from studies of Pavlovian-instrumental transfer in rodents and humans.

Our modern environment is said to be obesogenic, promoting the consumption of calorically dense foods and reducing energy expenditure. One factor thought to drive excess energy intake is the abundance of cues signaling the availability of highly palatable foods. Indeed, these cues exert powerful influences over food-related decision-making. Although obesity is associated with changes to several cognitive domains, the specific role of cues in producing this shift and on decision-making more generally, remains poorly understood. Here we review the literature examining how obesity and palatable diets affect the ability of Pavlovian cues to influence instrumental food-seeking behaviors by examining rodent and human studies incorporating Pavlovian-instrumental transfer (PIT) protocols. There are two types of PIT: (a) general PIT that tests whether cues can energize actions elicited in the pursuit of food generally, and (b) specific PIT which tests whether cues can elicit an action that earns a specific food outcome when faced with a choice. Both types of PIT have been shown to be vulnerable to alterations as a result of changes to diet and obesity. However, effects appear to be driven less by increases in body fat and more by palatable diet exposure per se. We discuss the limitations and implications of the current findings. The challenges for future research are to uncover the mechanisms underlying these alterations to PIT, which appear unrelated to excess weight itself, and to better model the complex determinants of food choice in humans.

Calculation of reserve estimation in the new pit design using mining software at PT. Tanjung Alam Jaya pit x, Banjar, South Borneo.

The mining planning and design were carried out in PT. Tanjung Alam Jaya, a coal mining company in South Kalimantan. The company intends to re-mine the Pit X area and requires a comprehensive mine planning approach to achieve its mining objectives. The study focuses on long-term planning, specifically optimizing the pit design while considering the company's specified stripping ratio limit and calculating the potential reserve volumes. The research aims to develop an optimized pit design and estimate the quantity of mineable reserves based on the optimization results. The findings include a mining layout design drawing and the calculated coal reserves that can be extracted from the optimized pit design. The excavation area spans 38.1 hectares, with excavation limits reaching a depth of -56 meters above sea level. The shape of the excavation extends from northeast to southwest, with a length of 1,065 meters and a variable width of 310 to 460 meters. The excavation features a slope height of 10 meters and a single slope angle of 65 degrees. Moreover, the haul road measures 21 meters in width with a 10% grade. The pit design indicates a total mineable coal reserve of 1,400,263.48 tons across all seams. Additionally, it reveals that 21,565,312.42 bcm of overburden / interburden must be stripped, resulting in a stripping ratio of 15.40 for the specific pit design. The haul road measures 21 meters in width with a 10% grade. In conclusion, this research demonstrates PT Tanjung Alam Jaya's efforts to optimize their pit design for re-mining in the Pit X area. The study provides valuable insights through a comprehensive mine planning approach, aiding the company in achieving their mining objectives while adhering to specified limits.

Flexible control of Pavlovian-instrumental transfer based on expected reward value.

The Pavlovian-instrumental transfer (PIT) paradigm is widely used to assay the motivational influence of reward-predictive cues, reflected by their ability to invigorate instrumental behavior. Leading theories assume that a cue's motivational properties are tied to predicted reward value. We outline an alternative view that recognizes that reward-predictive cues may suppress rather than motivate instrumental behavior under certain conditions, an effect termed positive conditioned suppression. We posit that cues signaling imminent reward delivery tend to inhibit instrumental behavior, which is exploratory by nature, in order to facilitate efficient retrieval of the expected reward. According to this view, the motivation to engage in instrumental behavior during a cue should be inversely related to the value of the predicted reward, since there is more to lose by failing to secure a high-value reward than a low-value reward. We tested this hypothesis in rats using a PIT protocol known to induce positive conditioned suppression. In Experiment 1, cues signaling different reward magnitudes elicited distinct response patterns. Whereas the one-pellet cue increased instrumental behavior, cues signaling three or nine pellets suppressed instrumental behavior and elicited high levels of food-port activity. Experiment 2 found that reward-predictive cues suppressed instrumental behavior and increased food-port activity in a flexible manner that was disrupted by post-training reward devaluation. Further analyses suggest that these findings were not driven by overt competition between the instrumental and food-port responses. We discuss how the PIT task may provide a useful tool for studying cognitive control over cue-motivated behavior in rodents. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Analysis of Groundwater Flows under the Fukushima Daiichi Nuclear Power Plant Reactors Using Contaminated Water from 42 Subdrain Pits

We analyzed groundwater collected from 42 subdrain pits (wells) located around the reactor buildings of plant units #1 to #4 of the Tokyo Electric Power Company Fukushima Daiichi Nuclear Power Plant (F1-NPP) to understand the groundwater dynamics and water flows around F1-NPP. Since water samples collected from this small area exhibit very similar water quality, there are difficulties in understanding the flow dynamics of the groundwater using conventional chemical analyses. In this study, we clarified the groundwater flows using an altitude-modified principal component analysis (PCA) with a total of 798 data items (19 factors × 42 pits) in the chemical analyses. The PCA results showed that six specific pits deviated from the common values and that the others contained contributions from both the natural elements and radioactive nuclides. The groundwater flows under units #1–#4 into two flow lines originating from two main water sources were classified, and these lines merged around the bayside of unit #2 due to the lower groundwater head. This method proved suitable for elucidating the groundwater dynamics and water flows in this small area by the proposed altitude-modified PCA.

The Motivational Determinants of Human Action, Their Neural Bases and Functional Impact in Adolescents With Obsessive-Compulsive Disorder

BackgroundEstablishing the motivational influences on human action is essential for understanding choice and decision making in health and disease. Here we used tests of value-based decision making, manipulating both predicted and experienced reward values to assess the motivational control of goal-directed action in healthy adolescents and those with obsessive-compulsive disorder (OCD). MethodsAfter instrumental training on a two action–two outcome probabilistic task, adolescents (n = 21) underwent Pavlovian conditioning using distinct stimuli predicting either the instrumental outcomes, a third outcome, or nothing. We then assessed functional magnetic resonance imaging during choice tests in which we varied the predicted value, using specific and general Pavlovian-instrumental transfer, and the experienced value, using outcome devaluation. To establish functional significance, we tested a matched cohort of adolescents with OCD (n = 20). ResultsIn healthy adolescents, both predicted and experienced values influenced the performance of goal-directed actions, mediated by distinct orbitofrontal-striatal circuits involving the lateral orbitofrontal cortex (OFC) and medial OFC, respectively. However, in adolescents with OCD, choice was insensitive to changes in either predicted or experienced values. These impairments were related to hypoactivity in the lateral OFC and hyperactivity in the medial OFC during specific Pavlovian-instrumental transfer and hypoactivity in the anterior prefrontal cortex, caudate nucleus, and their connectivity in the devaluation test. ConclusionsWe found that predicted and experienced values exerted a potent influence on the performance of goal-directed actions in adolescents via distinct orbitofrontal- and prefrontal-striatal circuits. Furthermore, the influence of these motivational processes was severely blunted in OCD, as was the functional segregation of circuits involving medial and lateral OFC, producing dysregulated action control.

Dorsomedial prefrontal cortex activation disrupts Pavlovian incentive motivation.

The dorsomedial prefrontal cortex (dmPFC) is known to make important contributions to flexible, reward-motivated behavior. However, it remains unclear if the dmPFC is involved in regulating the expression of Pavlovian incentive motivation, the process through which reward-paired cues promote instrumental reward-seeking behavior, which is modeled in rats using the Pavlovian-instrumental transfer (PIT) task. The current study examined this question using a bidirectional chemogenetic strategy in which inhibitory (hM4Di) or excitatory (hM3Dq) designer G-protein coupled receptors were virally expressed in dmPFC neurons, allowing us to later stimulate or inhibit this region by administering CNO prior to PIT testing. We found that dmPFC inhibition did not alter the tendency for a reward-paired cue to instigate instrumental reward-seeking behavior, whereas dmPFC stimulation disrupted the expression of this motivational influence. Neither treatment altered cue-elicited anticipatory activity at the reward-delivery port, indicating that dmPFC stimulation did not lead to more widespread motor suppression. A reporter-only control experiment indicated that our CNO treatment did not have non-specific behavioral effects. Thus, the dmPFC does not mediate the expression of Pavlovian incentive motivation but instead has the capacity to exert pronounced inhibitory control over this process, suggesting that it is involved in adaptively regulating cue-motivated behavior.

Obsessive-compulsive disorder is characterized by decreased Pavlovian influence on instrumental behavior.

Obsessive-compulsive disorder (OCD) is characterized by uncontrollable repetitive actions thought to rely on abnormalities within fundamental instrumental learning systems. We investigated cognitive and computational mechanisms underlying Pavlovian biases on instrumental behavior in both clinical OCD patients and healthy controls using a Pavlovian-Instrumental Transfer (PIT) task. PIT is typically evidenced by increased responding in the presence of a positive (previously rewarded) Pavlovian cue, and reduced responding in the presence of a negative cue. Thirty OCD patients and thirty-one healthy controls completed the Pavlovian Instrumental Transfer test, which included instrumental training, Pavlovian training for positive, negative and neutral cues, and a PIT phase in which participants performed the instrumental task in the presence of the Pavlovian cues. Modified Rescorla-Wagner models were fitted to trial-by-trial data of participants to estimate underlying computational mechanism and quantify individual differences during training and transfer stages. Bayesian hierarchical methods were used to estimate free parameters and compare the models. Behavioral and computational results indicated a weaker Pavlovian influence on instrumental behavior in OCD patients than in HC, especially for negative Pavlovian cues. Our results contrast with the increased PIT effects reported for another set of disorders characterized by compulsivity, substance use disorders, in which PIT is enhanced. A possible reason for the reduced PIT in OCD may be impairment in using the contextual information provided by the cues to appropriately adjust behavior, especially when inhibiting responding when a negative cue is present. This study provides deeper insight into our understanding of deficits in OCD from the perspective of Pavlovian influences on instrumental behavior and may have implications for OCD treatment modalities focused on reducing compulsive behaviors.

General and Specific Aversive Modulation of Active Avoidance Require Central Amygdala.

Three studies provide evidence that the central nucleus of the amygdala, a structure with a well-established role in conditioned freezing, is also required for conditioned facilitation of instrumental avoidance in rats. First, the immediate early gene c-Fos was measured following the presentation of a previously shock-paired tone in subjects trained either on an unsignaled avoidance task or not (in addition to tone only presentations in naïve controls). Significantly elevated expression of c-Fos was found in both the avoidance trained and Pavlovian trained conditions relative to naïve controls (but with no difference between the two trained conditions). In a subsequent study, intracranial infusions of muscimol into the central amygdala significantly attenuated the facilitation of shock-avoidance by a shock-paired Pavlovian cue relative to pre-operative responding. The final study used a virogenetic approach to inhibit the central amygdala prior to testing. This treatment eliminated the transfer of motivational control over shock-avoidance by both a shock-paired Pavlovian stimulus, as well as a cue paired with a perceptually distinct aversive event (i.e., klaxon). These findings provide compelling support for a role of central amygdala in producing aversive Pavlovian-instrumental transfer.

Sensory-Specific Satiety Dissociates General and Specific Pavlovian-Instrumental Transfer.

Pavlovian conditioning enables predictive stimuli to control action performance and action selection. The present experiments used sensory-specific satiety to examine the role of outcome value in these two forms of control. Experiment 1 employed a general Pavlovian-instrumental transfer design to show that a stimulus predicting a food outcome energizes the performance of an instrumental action earning another food outcome. This energizing effect was removed when the stimulus-predicted outcome or a novel outcome was devalued by sensory-specific satiety. Experiments 2 and 3 employed a specific Pavlovian-instrumental transfer design to demonstrate that a stimulus predicting a particular food outcome promotes the selection of an instrumental action earning the same, but not a different, food outcome. Remarkably, this effect was maintained when all or just one of the stimulus-predicted outcomes were devalued by sensory-specific satiety. These results indicate that satiety alone removes the expression of general PIT. By contrast, satiety or outcome-specific devaluation does not regulate the expression of specific PIT, which is insensitive to changes in outcome value. This dissociation is consistent with the view that general and specific PIT are two separate phenomena driven by distinct psychological mechanisms.

Effects of Motivational Downshifts on Specific Pavlovian-Instrumental Transfer in Rats.

BackgroundPavlovian stimuli predictive of appetitive outcomes can exert a powerful influence on the selection and initiation of action, a phenomenon termed outcome-selective Pavlovian-instrumental transfer (sPIT). Rodent studies suggest that sPIT is insensitive to motivational downshift induced by outcome devaluation, an effect that is, however, relatively underexplored.MethodsHere we examined in detail the effects of distinct shifts in motivation from hunger to a state of relative satiety on sPIT in rats.ResultsA motivational downshift by outcome-specific devaluation immediately prior to testing markedly reduced overall lever responding and magazine entries but left intact the sPIT effect. A motivational downshift prior testing by (1) giving ad libitum rather than restricted access to maintenance diet in the home cage for 24 hours or by (2) a systemic blockade of hormone secretagogue receptor subtype 1A receptors to inhibit orexigenic actions of ghrelin both reduced overall lever responding and magazine entries. Moreover, these latter motivational downshifts reduced the sPIT effect; however, the sizes of the sPIT effects were still large.ConclusionsCollectively, our rodent findings indicate that major effects of various motivational downshifts are overall inhibition of lever pressing and magazine approach, possibly reflecting reduced general motivation. The observed effects of motivational downshifts on sPIT have implications with regard to the role of general motivating effects in sPIT and to the contribution of Pavlovian-instrumental interactions to excessive food seeking as well as obesity in humans.

Disruption in Pavlovian-Instrumental Transfer as a Function of Depression and Anxiety

Disruption in Pavlovian-Instrumental Transfer as a Function of Depression and Anxiety

Individual concerns modulate reward-related learning and behaviors involving sexual outcomes.

Pavlovian and instrumental conditioning are fundamental processes helping organisms learn about stimuli that predict rewards in the environment and actions that lead to their obtainment. These two forms of learning and their interplay notably exert a strong impact on reward-seeking behaviors. Here, we examined in humans whether Pavlovian and instrumental learning along with their effects on cue-driven behaviors involving sexual rewards are modulated by the reward relevance to the individual’s sexual orientation. In two experiments, we manipulated the concern-relevance of sexual outcomes in a Pavlovian-instrumental transfer paradigm by recruiting heterosexual and homosexual men and selecting sexual stimuli for each sexual orientation. Results showed enhanced instrumental and Pavlovian learning in response to the most relevant sexual outcome to participants’ sexual orientation as well as increased reward-seeking behaviors in response to its associated cue compared to the less relevant sexual outcome and its associated cue, respectively, thereby reflecting that inter-individual differences in sexual concerns modulated these effects. These findings suggest that motivational influence on reward-related learning and behaviors involving sexual stimuli relies on inter-individual differences in concerns and contribute to fostering further insight into the mechanisms underlying human reward-seeking behaviors.

Development of an Impairment Point in Time Probability of Default Model for Revolving Retail Credit Products: South African Case Study

A new methodology to derive IFRS 9 PiT PDs is proposed. The methodology first derives a PiT term structure with accompanying segmented term structures. Secondly, the calibration of credit scores using the Lorenz curve approach is used to create account-specific PD term structures. The PiT term structures are derived by using empirical information based on the most recent default information and account risk characteristics prior to default. Different PiT PD term structures are developed to capture the structurally different default risk patterns for different pools of accounts using segmentation. To quantify what a materially different term structure constitutes, three tests are proposed. Account specific PiT PDs are derived through the Lorenz curve calibration using the latest default experience and credit scores. The proposed methodology is illustrated on an actual dataset, using a revolving retail credit portfolio from a South African bank. The main advantages of the proposed methodology include the use of well-understood methods (e.g., Lorenz curve calibration, scorecards, term structure modelling) in the banking industry. Further, the inclusion of re-default events in the proposed IFRS 9 PD methodology will simplify the development of the accompanying IFRS 9 LGD model due to the reduced complexity for the modelling of cure cases. Moreover, attrition effects are naturally included in the PD term structures and no longer require a separate model. Lastly, the PD term structure is based on months since observation, and therefore the arrears cycle could be investigated as a possible segmentation.

Real-time prediction and assessment of hydrogeological conditions in pit wall rock mass using advanced computer technologies

For the feasibility study of preventive drainage, it is often required to evaluate groundwater inflows in specific pit areas, to identify seepage height in pit wall, and to determine hydrodynamic parameters of flow in the existing geological and hydrogeological conditions. The authors have identified methodological approaches, technological methods and schemes, and combinations of software tools that allow automation of evaluating and predictive studies of hydrogeological conditions in certain areas of open pits using 3D models and finite element methodbased calculations. To solve these tasks, we have tested the dynamic geological simulation software system Leapfrog Geo (Seequent) in combination with the dedicated calculation module Slide2 (Rocscience Inc.). A promising area of joint application of Leapfrog Geo and Slide software is real-time permeation calculations in areas of complex geological and hydrogeological conditions, where grapho-analytical methods provide very approximate and rough results, whereas 3D software products (like MODFLOW or FEFLOW) require too much time and labor input, or even are inapplicable due to lack of modeling source data. The water inflow estimation procedure included determination of specific water inflow in the profile which passed through the center of the flow path, and multiplication of the result by the width of the pit wall intake area with regard to nonuniform permeability of rocks.

General Pavlovian-instrumental transfer tests reveal selective inhibition of the response type – whether Pavlovian or instrumental – performed during extinction

The present experiments examined whether extinction of a stimulus predicting food affects the ability of that stimulus to energize instrumental performance to obtain food. We first used a general Pavlovian instrumental transfer (PIT) paradigm in which rats were first given Pavlovian conditioning with a stimulus predicting one type of food outcome and were then trained to lever press for a different food outcome. We found that the Pavlovian stimulus enhanced performance of the lever press response and that this enhancement was preserved after extinction of that stimulus (Experiment 1) even when the context was manipulated to favor the expression of extinction (Experiment 2). Next, we assessed whether extinction influenced the excitatory effect of a stimulus when it was trained as a discriminative stimulus. Extinction of this stimulus alone had no effect on its ability to control instrumental performance; however, when extinguished with its associated lever press response, discriminative control was lost (Experiments 3 and 4). Finally, after instrumental and Pavlovian training, we extinguished a Pavlovian stimulus predicting one food outcome with a lever press response that delivered a different outcome. In a general PIT test, we found this extinction abolished the ability of the Pavlovian stimulus to elevate responding on a lever trained with a different outcome, revealing for the first time that extinction can abolish the general PIT effect. We conclude that extinction can produce an inhibitory association between the stimulus and the general response type, whether Pavlovian or instrumental, performed during the extinction training.